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CONVKRGOJCE  PROPERTIES  OF  A PIES-TYPE 
ALGORITfCI  FOR  NON-INTEGPJ\BLE  FUNCTIONS 
by 

Caulton  L,  Irwin 


1.  INTRODUCTION 

The  aim  of  this  paper  is  to  study  the  technique  used  in  the  FEA-PIES 
energy  model  for  approximating  non-integrable  vector  functions.  An  algorithm 
which  incorporates  this  technique  to  obtain  market  equilibrium  in  the  presence 
of  non-integrable  functions  is  described  in  section  2.  The  main  convergence, 
existence  and  uniqueness  theorem  is  stated  and  a geometric  interpretation  of 
the  algorithm  is  given  for  n = 2.  Section  3 indicates  some  effects  of  a linear 
coordinate  transformation  on  the  algorithm  and  contains  an  illustrative  example. 
The  proofs  are  in  section  4. 

Trie  complete  report  on  the  FEA-PIES  energy  model  is  contained  in  [5].  A 
description  of  the  quantitative  analysis  as  well  as  an  interesting  example 
problem  is  contained  in  Hogan's  paper  C3].  The  mathematical  structure, 
algorithms  and  computational  experience  are  presented  in  [4],  The  algorithm 
considered  below  can  be  viewed  as  a sub- algorithm  of  the  PIES  algorithm. 


Hopefully,  the  methods  of  proof  and  observations  will  aid  in  understanding  the 
convergence  of  the  PIES  algorithm  and  will  indicate  its  connection  with 
quasi-Newton  methods  as  siu'veyed  in  Cl]. 


Suppose  Pg  is  a supply  price  function,  P^  is  a demand  price  function  eind 


e = P„  - Pj^.  If  e is  integrable,  i.e.  , e = VE  for  some  function  E from  into 
R^,  then,  provided  E is  convex,  calculating  q*  such  that  e(q*)  = (0,  , . ..  ,0) 


is  equivalent  to  solving  the  optimization  problem 


min  E(q). 


(2) 


In  this  ciise,  -E  represents  a net  social  surplus  function  and 

so  this  welfare  measure  of  the  economy  is  maximized  at  q*. 

If  e is  not  integrahle,  which  in  general  is  the  case  for  n > 1,  the 
problem  of  obtaining  q*  with  an  optimization  process  can  be  approached  by 
approximating  e with  an  integrable  function  e.  A vector  q such  that  e(q)  = (O,  . . .,0) 
is  then  obtained  as  a solution  of 
<1)  min  ^(q) 

q 

and  q may  be  taken  as  an  approximation  to  q*. 

For  the  functions  in  PIES  it  is  actually  that  fails  to  be  integrable  and 

so  the  approximation  technique  is  applied  only  to  P^.  For  the  algorithm  described 

in  section  2,  the  same  approximation  technique  is  used,  but  it  is  applied  to 
Pg  - Pp.  In  either  case,  an  integrable  e results. 


2.  THE  ALGORITHM  AND  CONVERGENCE  THEOREM 

Let  J (a ) denote  the  Jacobian  matrix  of  e at  q,  i.e.  , J (q)  is  an 
e ■ * ' e . 

n X n matrix  whose  i^^  row  is  (Ve^^^)  (q).  The  PIES  technique  for  approximating  a 
non-integrable  vector  function  u with  respect  to  to  the  point  q^  is  simply  to 
define  e^  as  the  vector  function  such  tha>. 


and 


«J^^(q)  = diag  Jg(q) 
e 


At.  t.  , t. 
e (q  ) = e(q  ). 


At 


This  provides  that  e has  coordinate  functions  given  by 
(2)  e}  (q)  = e^  (q^^,  . . . ,<^) 

= e^  (q^,  ...»  qT_^,  q^,  , qj) 

for  i=l,.  . . ,n. 

At  is  integrable  since  it  has  a diagonal  Jacobian  matrix;  in  fact. 


(3) 


where  p 

(3)  E"(q)  = 4s<i3 

■ J t <l2’  * * • * 

Tt  *2^*  ^2»  4 


+ . . . 


+ A * • • » Vi» 

% 

The  point  can  now  be  obtained  via  (1).  By  letting  = q^  a sequence 

q'*’,  . . . is  generated  which  nvay  converge  to  a point  q such  that  e(q  ) = 

(0,  . . . • O).  Refer  to  this  algorithm  as  SUB-PIES.  A diagram  of  SUB-PIES 
and  for  comparison  purposes  a diagram  of  PIES  is  sho’^n  in  figure  1. 

Assume  for  the  discussion  that  for  each  i = 1,  . . . > n,  there  is  an 
interval  1^^  - so  that  if  R = 1^^  x . . . x I^,  then 

(4)  e^(q)  < 0 for  q^  = and  q^e  1^  all  j s'  i; 

(5)  e^(q)  > 0 for  q^  = b^  and  q^  £ 1^  all  j * i; 


(6)  3e. 

— — is  defined  and  continuous  on  R for  j = 1,  . . . , n; 

3q. 

3 

9e. 

(7)  there  is  an  £ > 0 so  that  -r— ■ > e on  R. 

3qi 

Assume  further  that 

(8)  k.  . = sup  <1^  (q))/l^q>l  I q c R.  j * i)  < - 

tind  let  k denote  the  n x n matrix  where  = 0 for  i = 1,  . 


• » n. 


PIES  SUB-PIES 


Let  f>(k)  = sup  {|a1 


X is  an  nit'cnvalue  of  k),  i.c.,  p(k)  is  the  spectral 


radius  of  k. 

It  should  be  noted  that  in  PILS,  Pg  is  integrable,  since  it  is  obtained  from 
a linear  pro^raiiiming  process  analysis,  but  it  is  not  everywhere  differentiable. 

On  the  other  hand,  is  differentiable  but  not  necessarily  integrable.  The 
result  is  that  e = Pg  - for  PICS  functions  is  not  necessarily  differentiable 
and  not  necessarily  integrable.  In  order  to  concetrate  on  the  non-integrability 
aspect,  condition  (6)  will  be  assumed  for  the  functions  in  SU3-PIES. 

Our  main  theorem  concerning  SUB-PIES  is  : 

Theorem  1.  Suppose  (4),  (5),  (G)  and  (7)  hold.  If  p(k)  < 1,  then  the 

12  * 

sequence  q , q , ...  generated  by  SUB  - PIES  converges  to  a point  q such  that 

e(q* ) = (0,  ...  , 0).  Furthermore  q is  unique. 

Proof.  See  part  4. 

Two  situations  in  which  p(k)  < 1 can  be  seen  by  applying  the  Gershgorin 
circles  Theorem,  see  [7].  One  case  is  when  for  j i.  This  condition 

e>q)resses  the  econoruc  reality  that  the  quantity  demanded  and  produced  of  a 
good  is  more  strongly  related  to  its  own  price  than  to  the  cross  prices. 

Also,  it  has  been  pointed  out,  [2],  that  if  we  let  k^  = max  | jj^i) 

and  k denote  the  n x n matrix  where  = j if  ^ ^ 


0 if  j = i. 


then  k is  similar  to  the  symmetric  matrix  k where 


k.  . = /k.  k , . 

ID 

Anolyirg  Gershgorin 's  Theorem  again,  this  time  on  k,  we  find  that 

p(k)  5 p(k)  = p(k)  < 1 

provided 

(2)  /IT  + ...  + ■*'  *^Y+i  ^ ^ **’* 

It  is  interesting  to  note  tnat  any  one  of  the  k.  ’s  can  be  arbitrarily  large 
provided  the  other  (n-1)  of  the  kw  's  are  "small  enough". 


(6) 


The  geoTT.etric  interpretation  of  the  induction  step  in  SUB-PIES  can  be 
seen  clearly  for  n = 2.  Let  denote  tlic  level  set  of  e^  for  function  value 
0,  i.e. , 

= {q  e R I e^(q)  = O)  for  i = 1,2 

Obviously  q*  c n S^.  At  q^ , as  shown  in  figure  2,  the  integrable  approximation 

e^  is  defined  by  (2)  and  when  the  corresponding  is  minimized  a point  q^ 
is  obtained  so  that 

(V^)  (55  = e^(q^)  = (0,0). 

We  have 

At  ,At. 

(q  ) = 

,At  tv 

SO  (q^^,  q^)  c 


At  ,At  Atv 
®1  '^1’  *^2^ 

.At  tv 

Oj,  (ij.  qp 


Sj^  ; also. 


(7) 


At  ,At.  At  ,At  At. 

62  (q  ) = ^2  (qj^,  q2) 


ft  At. 

= *^^2' 


= 0 

and  so  (q^,  q^)  € S^. 

The  geometric  interpretation  is  that  q^  as  determined  by  the  optimization 
scheme  in  (l)  is  the  first  coordinate  of  the  intersection  of  the  line  q2  = q 

with  the  level  set  Sj^.  Similarily,  q^  is  the  second  coordinate  of  the 
intersection  .-.t  the  line  q^^  = q^  with  the  level  set  S2.  Let  q^^^  = q*. 

In  order  to  estimate  the  error  = | q^^^  - q^^  I and  to  get  an  indication 

of  the  proof  of  theorem  1,  let  be  defined  implicitly  on  I2  by  (q2^»  *12^ 

Tnen,  is  the  graph  of  and  since  q^^^  “ have 


‘1  = 


t+1  * 

- q. 


= I (q^)  - Uj^  (q")! 

= I n "i  ‘’2’  '”2 


I n I “i  <^2> 


dq. 


t »' 
^12  - 


where  1 1 u. 


'jL  i • = {|uj^(q2J|  j ^2  ^ ^2^* 

Recalling  the  notation  from  (8),  [j  1 1 ^ ^^12  SO, 


ao)  4'-" 


Similarily  we  can  obtain  that 

(U)  a'  a _ 


K)  i4 


Notice  that  tlie  numhcr  reprc-Gcntr.  an  iipprjr  hoinfl  on  the  r.lope  of 
with  respect  to  q2  as  well  as  a boimd  on  ratios  of  certain  partial  derivations 
which  can  be  related  to  the  demand  elasticities  in  I’lhS.  Similar  comments 
hold  for  as  well  as  for  in  general. 

3.  EffECTS  OF  A LINEAR  COORDINATE  CHANGE 

1 2 

In  general,  the  convci’gencc  of  q , q , . . .as  generated  by  SUB-PIES 
depends  upon  how  closely  the  level  sets  of  e^  are  approximated  by  the  q^  = 
"constant’*  coordinate  planes.  This  is  because  the  q^  "constant"  coordinate 
planes  are  also  the  level  sets  of  eT.  In  terms  of  extending  the  applicability 
of  SUB-PIES  and  making  it  more  comparable  with  PIES  it  is  suggested  to  impose  a 
new  linear  coordinate  system  , r^)  on  q-space  so  that  r^^  = "constant" 

coordinate  planes  are  first  order  approximations  to  the  level  sets  of  e^  at 
some  point  w e R.  This  suggestion  is  illustrated  in  figure  3 for  n = 2 in 
which  w = q , q is  the  approximating  point  determined  by  using  the  r-coordinate 

system  and  q^  is  determined  as  before  in  the  q-coordinate  system. 


Figure  3 


The  coordinate  transforriation  needed  is  r = Oq  where  G - J (w).  If  G*  exists 

e 

then  we  can  let  f(r)  = e(0  r)  and  atte;;:.t  to  apply  SUi3-Pli:S  to  f(r).  The 
following  theorem  chows  that  the  coordinate  change  offers  a local  advantage  in 
terms  of  satisfying  the  conditions  for  convergence  of  SUB-PIES. 

Theorem  2.  If  0 ^ exists,  then  there  is  a neighborhood  N of  s = 0w  so  that 
if  R c N,  then  p(k)  < 1. 


Proof.  The  theorem  is  true  because 
3f  fo  if  i ;<=  j 

3^rCs)- 

3 Vl  if  1 = 3 


and  — — is  a continuous  function  of  r.  See  section  (4)  for  details. 

3r. 

3 t 

Tne  coordinates  can  be  chcinged  to  "suit  the  problem"  at  each  q where 

[J  (q^)3  ^ exists,  thus  suggesting  a variation  on  the  SU3-PIES  algorithm. 


Also,  a single  coordinate  change  with  respect  to  a point  in  the  vicinity  of  the 
equilibrium  can  produce  a situation  in  which  the  hypothesis  of  Theorem  1 is 
satisfied.  This  is  illustrated  by  the  following  example. 


Example  1 , 


Let  e = e^)  be  defined  by 


^ - <12  + io 

^2^  ""  *^1  ^ ^‘^1  " ^2 


2 S q^^  3 
7 S 11  . 


^Cq) 


2q^+2  -1 


llien 


(10) 


and 


12 


sup 

q‘ 


l-i|  _ 


= sup  Iq  I = 3 
'll  ^ 


2q^+2 


k = sup  T-,-  = sup  |2q  +2]  = 8. 

q -J-j  J- 


Clearly  the  conditions  for  convergence  are  not  satisfied  in  the  q- 


Let  w = (2,10),  then  0 = J^(w)  =[  h -1 


and  0~^  = ^ f -2 


6 -1  / I -12 

In  r-coordinates  determined  by  r = 0q  we  have  f(r)  = e(9’"^  r) 

(Vf)(r)  = (Ve)(0“^  r)  0~^ 

2 


2\. 

and 


= 

11 


+ 12 


- 4qj^  + 8 


4q^+  3 


where  q^  = (r). 

In  the  r-coordinates , 
k 


12  = 2 


1 - 1 


< 1 


qq  ^ 2 


- - + 12 


^21  " 


-4q^  t 8 
4q^  + 3 


< 1 for  q2  ^ 


which  means  that  p(k)  < 1 for  any  R such  that  Rs{  q|  q^  ^ 


Also 


^ (r)  = ^ (-^  + 11)  > f, 
dr^  11  11 


’^2  1 

““  S?^  ' n ^ 3)  > Ij, 


1 3 

for  any  R s,  (qlq^  ^ which  means  c = fulfills  condition  (7). 


coordinates . 


so 


(U) 


It  can  be  shcv;  that 


< 0 


fl(-7.  r^)  > 0 

-4)  < 0 


€ [-4,5] 


e [-11,  -7] 


e [-11,  -7] 


i.e.,  conditions  (4)  and  (5),  are  satisfied  for  = [-11,  -7]  and 
^2  ~ ["*♦»  ^3*  ^ ~ ^1  ^2  r-coordinates  is  contained  in  {qj  q^^  i ?s) 


so  all  the  conditions  for  convereence  of  SUB-PIES  are  satisfied.  The 

’ii 

equilibrium  point  q can  now  be  obtained. 

The  following  theorem  is  a "local"  converse  of  Theorem  1. 

* . . . * 

Tneorem  3.  Suppose  q is  an  equilibrium  point,  i.e.  e(q  ) = (0,  . . . , 0), 

-1  ••  -1  * 
and  0 = [^^(q  )]  exists,  then,  locally,  SUB-PIES  converges  to  q in  the 

r-coordinate  system  given  by  r = 0q. 

Proof.  Theorem  2 and  an  implicit  function  Theorem  provide  that  the 
conditions  for  convergence  of  SUB-PIES  are  satisfied.  See  section  (4)  for 
details . 


4 . PROOFS 


In  Theorem  1,  assume  there  are  intervals  I^  so  that  (4),  (5),  (6)  and  (7) 

t - At  ^t 

hold  and  let  q be  a point  of  R.  Let  the  functions  e and  E be  defined  by 

equations  (2)  and  (3)  respectively.  Condition  (7)  guarantees  that  the  Hessian 

mat  'ix,  is  positive  definite;  therefore,  e^  is  strictly  convex  on  R and 

so  has  a unique  minimum  at  q^  where 

(9)  e^(q^)  = (VE^)  (q^)  = (0,  . . . , 

Lotting  Sjj^  = {q  I e^(q)  = 0),  it  follows  from  (9)  that 


0). 


(12) 


(10) 


At, At,  At  ,At  At. 

ej.(q  ) = (q^ q^) 


- « / t t At  t tv 

■ 'i  '■’i li-  “ifa’  • • • S.’ 


= 0 


c>nd 


ft  t At  t t. 

SO  • ' • 9 ‘)j_»  ^i+i»  • • • » t This  point  can  be  interpreted 


as  a partial  equilibrium  with  respect  to  the  i^^  quantity.  Equation  (10)  also 
guarantees  that  q^^  c and  so  q^'  c R.  By  an  implicit  function  theorem  there  is 


a function  u.  defined  on  R.  = I,  „ 
a 1 1 


• * ^i-1  ^itl  * 


X I so  that 
n 


• • • » • • • . Qi+i*  • • 

for  all 

a.  = (qjL.  . . • » , q^)  c R^. 


qn).  q 


i+1’ 


Mote  that  is  the  graph  of  u^. 

I 4.*-  t+1  At  . 

Letting  q = q we  obtain 
(11)  A*  = |q^+^  - q^l 


= |u^(a^)  - u^(a^"^)| 


l£ 


r t-1  t-,  ^'^i 

fc,.  ; a,3 


j=i 


"1 

t-1 


9u. 

1 


3q. 

3 


j=l 


t 

/qj 


t-1 


9u . 
1 


dq . 


(13) 


3e , 

5 

n 

■^j 

3=1 

t-1 

Be . , 
1 

aqj 

dq. 


j=l 

i="i 


t t-1 
q.  - q. 

D J 


k*.  . 


a!-" 


j"l 

where  the  k. . 's  are  defined  by  (8). 

Inequality  (11)  can  be  formulated  as 

(12) 

We  can  now  obtain  fr-om  (12)  that  A*",  the  vector  of  successive  differences 
satisfies 


< k 


where  A^  = (A^,  . . . , 


(13)  A^  S k^A®. 

Using  (13)  ai.d  standard  ivisults  in  matrix  analysis,  we  obtain  that  the 

sequence  q^,  q^,  . . . generated  by  S'JB-PIES  is  a Cauchy  sequence  in  R provided 
s’:  2 

p(k)  < 1.  Let  q be  the  point  to  which  q , q , . . . converges.  To  see  that 

e.(q  ) = 0,  let  x.  = (q, , . . . , q.  , , q.  , q.^,,  . . . , q ) and  recall 
i 1 1 i-l  .1  u+1  ‘n 

t .12 

from  ( lo)  that  H can  be  shown  that  for  each  i,  x^,  x^,  . . . 

i:  * 

converges  to  q and  £.o  by  the  continuity  assumption  on  e^,  e^(q  ) = 0; 

J. 

hence  o(q  ) = (0,  ...»  0). 

It  is  interesting  that  uniqueness  of  the  equilibrium  point  also  follows 
fro;:i  the  condition  p(k)  < 1.  Suppose  q is  fuiothcr  point  in  R so  that 
c(q)  = (0,  . . . , 0).  Tn  a manner  similar  to  how  (13)  was  obtained  we  get 


(I'O 


A. 

1 


qi  - qV  I 

u^(d^)  - u.(a‘  ) I 


Vu 


n 

s k..  A. 

Z—  13  3 

j=l 
2^i 

And  so  A ^ kA,  which  implies  that 

(!*♦)  AS  k'^A  for  all  n 

T 

where  A = (A, , . . . , A ) . 

1 n 

It  is  clear  fron!  (14)  that  p(k)  < 1 implies  A=(0,  . . . , 0),  i.e.. 

In  Theorem  2,  we  liave  9 = J (w),  s = ©w  euid  f.(r)  = e.(0”^r),  so 

af.  , , 

(15)  ~ (r)  = (»/e.)  (0"-^r)  * C.(0"  ) 

"qj  1 3 

where  we  are  using  the  notation  that  = the  column  of  the  m x 

Fixun  (15), 


(16) 


af . 1 

ar!  <-> 

3 ' 

|^(Vp^)(w)  . 

Cj(0"^ 

af. 

1 

j (Ve^)(w)  • 

C^(0”^ 

j = i 


matrix  M. 


I o* 


(IS) 


3f^ 

With  the  contimiLty  of  nt  s,  v: 

j 

for  any  R = x . . o N,  p(k) 

4i 

In  Tneoreni  3,  let  r = Oq  ; 
r so  that  p(k)  < 1 for  any  R c N. 


i:  can  j'.narantce  a iiei  ght>orhood  N of  s so  that 

< 1.  Ai:,ain  reference  [7]  is  appropriate  here, 
iheoivm  ? provides  a neighborhood  N of 
Since  f^Cr  ) = 0 and 


for  i=l,  . . . , n thert:  will  be  a set  R in  the  forin  I,  x . . . x I c N so  that 

in 

(4),  (S),  (6)  and  (7)  hold  in  t)»e  r - coordinate  system.  Since  R c N,  p(k)  <1 

12  * 
and  so  a sequence  r , r , . . . generated  by  SUB-PIbS  must  converge  to  r . 


b.  !-iISCELL.»::E0J3 
In  terr::;  of 
in  SUB -Pins  which 
between  the  . 's 

for  approximating 


future  work  it  would  be  nice  to  )>e  able  to  deal  with  functions 
ar-.;  not  everywherv  differentiable  and  to  find  explicit  relations 
and  the  dem.md  elasticities.  There  are  also  other  possibilities 

ncn-integrable  functions,  eg.  define  e^  sucii  that 


and  e^(q^)  = c(q^). 

It  is  interesting  to  note  that  one  ctcj>  in  John  Neuberger's  iterative  method  of 
solving  non-linear  partial  di  ffer'ontial  equations  is  to  approximate  a non-conservative 
vector  field  by  its  "nearest"  conservative  vector  field,  see  [6].  This  method 
would  perhaps  offer  another  means  of  obtaining  on  e^.  It  has  been  suggested 
that  using  bUB-PirS  in  the  price  .space  would  faci.lilate  relating  the  demand 
elasticitie:.  to  the  conditioiis  for  convergence. 
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